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REMARKS 

Rejection of claims 1-7, 9-15, 17-18, 32-33, 35-36, 38, 43, 45-47, 51, 56-57, 62-69, 77-80 
under 35 USC 112 first paragraph 

In the Examiner's Office Action of March 1, 2011, the examiner has rejected all the 
pendmg clahns as failmg to comply with the written description requirement. Specifically, the 
examiner has noted that clauns 1, 12, 15, 17, and 62 include the limitation of "spatial and 
temporal parameters" that poses a problem under section 112 first paragraph. 

Applicants respectfully disagree. The examiner is referred to the origiaal disclosure of 
apphcation 08/418823 which is the parent filing of US 5,625, 410 which is the subject of this 
reissue application. The specification, clauns and drawings are attached to this paper and was 
downloaded from the PAIR interface. In the 08/418823 application, original claim 14 recites: 

"displaymg at least certam of the digitized images ui separate windows on a 
display device, using a first set of temporal and spatial parameters associated with 
each image in each window; 

simultaneously storing the displayed unages usmg a second set of temporal and 
spatial parameters associated with each unage." [Emphasis added,] 
In addition, original claim 15 recites: 

"The method of claim 14, the temporal parameters including frame rate ." 
[Emphasis added.] 
Furthermore, original claim 16 recites: 

"The method of claim 14, the spatial parameters including image dimensions 
in pixels ." [Emphasis added.] 
Additionally, the identical termmology and phrasing is present in the issued patent, US 5,625,410 
(which is the subject of this Re-Issue Application), in previously allowed claims 12, 13, and 14 
as shown below: 
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12. The method of smiultaneously displaying and storing multiple video images, comprising the 
steps of: 

receiving video images from a plurality of sources; 

digitizing one or more of the images if not ahready in digital form; 

displaying at least certain of the digitized images m separate windows on a display device, using 
a first set of temporal and spatial parameters associated with each hnage in each window; 
simultaneously storing the displayed images using a second set of temporal and spatial 
parameters associated with each image. 

13. The method of claim 12, the temporal parameters includmg firame rate. 

14. The method of claim 12, the spatial parameters mcluding image dimension in pixels. 

Thus, the terms, spatial and temporal parameters in the claims in conjunction with the 
specification and examples was described and complies with the written description reqmrement 
and applicant's attorney respectfully requests withdrawal of the rejection. 

Additionally, the terms of spatial and temporal parameters was in use at the time of the 

filing of the invention and were known to one of skill in the art. In their book "HDTV - 

Advanced Television for the 1990s" (published 1991 and attached to this paper), respected 

authors K. Blair Benson and Donald G. Fink state: 

"The unages picked up by a television camera are sampled in space and m time. The line 
structure represents samplmg in the vertical axis, hi digital processing, each line is 
sampled by the analog-to-digital converter, thereby producmg samples in the horizontal 
axis of the image. These perpendicular samplmg processes provide the spatial analysis. 
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The field and ftame repetitions provide the temporal sampling of the image. The signal 
content of all three dimensions must be exploited by the system designer to take Ml 
advantage of the channel's capacity to carry information. This approach, spatio-temporal 
analysis, has become an essential tool in advanced television system development " 
(Page 5.1) 

Thus, the Applicants respectfully suggest that these terms both were in common usage at 
the time of the invention and applicant's attorney respectfully requests withdrawal of the 
rejection. 

In view of the above amendment, applicant believes the pending application is in 
condition for allowance. 
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Fig. 2 14" TO 17" SVGA MONITOR 
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Fig. 5 20" TO 21 SUPER HIGH RESOLUTION MONITOR 
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VIDEO MONITORING AND CONFERENCING SYSTEM 

This application is a continuation-in-part of cp- 
pendxng U.S. Serxal Nos. 08/050,861, filed April 21, 199^ ' 
and 08/298,104, filed August 30, 1994. _ t> . ./\ ,^ r. 

Field of the Invention 
This invention relates generally to .video 
monitoring, and, more particularly, to such systems 
employing means for digitizing camera images for display at 
a first image size, sampling rate, and frame rate, and for 
digital storage at a second image size, sampling rate, and 
frame rate . 

Backgroux>d of th e.Jjayiefl tiQU 

Existing systems for monitoring video signals 
from multiple sources either have relied upon switching 
means to secjuence through each of the sources in a 
predetermined pattern, or else implement some form of 
"split screen" display, in which a conventional video 
monitor displays, for example, the output of four cameras, 
each occupying a portion of the display screen. Often, the 
video output is also supplied to signal storage means such 
as a VCR which is operated in a single -frame recording 
mode, providing a time-lapse record of the camera outputs. 
These types of systems are in common usage, and are well 
known in the art . 

More recently, the availability of digital 
techniques for video signal processing and data compression 
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has opened new video monitoring- alternatives. Mathisen, 
for example, U.S. Pat. No, 4,198,656, describes a system 
employing a signal selector which is controlled hy signal 
storage means, including a VCR functioning as a time-lapse 
5 frame recorder, and disc storage means functioning as a 

frame- store type device which provides continuity in the 
display while the selector is advancing through its 
sequence to the next signal source, or to the next recorded 
signal from one particular source. Each image is further 

10 provided with a digital code, which enables the image 

source to be identified upon playback. 

Katz (U.S. Pat. No. 5,215,502) discloses a System 
for monitoring and recording transactions at multiple 
cashier lanes. According to the preferred embodiment, 

15 output' signals from four cameras are fed to a four -quadrant 

multiplexer, which contains a frame store having provisions 
for reducing each camera image to one-quarter size and then 
displaying it in one of the four quadrants of the video 
monitor. The combined output signal is then recorded on a 

20 Video Cassette Recorder (VCR) to provide a more permanent 

record -of the transaction. No description is given of the 
size-reduction method, but this kind of display may be 
implemented by employing a time- compression scheme for the 
horizontal lines, and eliminating alternate scan lines from 

25 the vertical dimension of the video frame. Data from the 

individual cash registers is encoded digitally, and then 
either recorded on lines of video in the vertical- interval 
or else recorded on the audio tracks of the vcR. The 
monitoring provisions include a video overlay generator, so 

3 0 that transaction information may be displayed concurrently 

2 
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with images of the event. Provisions are also included for 
selective recording of representative frames of video, as 
triggered by transaction events at individual cashier 
lanes. This further reduces the number of frames recorded, 
5 and extends the recording duration of the video cassette. 

Neither of these two inventions disclose the use 
of image data compression schemes, nor of image resizing by- 
digital means. Katz does disclose selective recording of 
frames of video, but only in analog form, and using 

10 conventional video recording means, such as a VCR, 

Blum et al. (U.S. Pat. No. 5,237,408) disclose a 
system employing multiple interface circuit boards- 
containing provisions for capturing and digitizing images 
from a plurality of cameras, further storing a slow-scan 

15 sequence of images for each camera in active buffer memory 

means as RAM on each of the interface boards. The display 
of these image sequences is preferably controlled by a PC 
with disk storage capabilities, and individual images 
selectively may be recorded on the hard disk, under 

20 operator control. Storage capacity is limited, however, 

because no image data compression is provided, and it is 
not practical to store large quantities or sequences of 
images. There are no provisions for automatic recording of 
images, nor any provision for storing these images in a 

2 5 . data form differing from the display format image size. 

Gormley (U.S. Pat. No. 5,258,837) discloses video 
compression means as a method for fitting multiple camera 
images within a single video display screen. However, 
Gormley clearly indicates that the system relies on fixed 

30 image-size compression of the digitized incoming video 
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signal, and does not perform any kind of bandwidth 
compression. Provisions are included for storing images on 
a video recorder, but, as in other systems, these images 
are stored by taking the screen display as a whole, rather 
5 than storing independently constituted representations of 

the individual camera outputs . 

In general, these conventional systems, 
regardless of the subsequent signal processing employed, 
accept analog video signals from the camera sources for 

10 input to the monitoring system. As such, these signals are 

susceptible to disturbances such as R.F interference, 
ground-loop noise, and high-frequency signal loss due to 
long runs of coaxial cables. Automatic video switcher 
units sequence the source signals at a relatively slow 

15 rate, requiring as much as 16 seconds delay between 

successive viewings of a particular source when using a one 
source-per- second rate to sequence through 16 sources. 
When such a system is equipped with a time-lapse video 
recorder, the recording medium is expensive, has low 

20 resolution, and is limited in recording capacity. 

Other systems, such as video conferencing 
arrangements, use multiple camera images and audio sources 
which are coordinated through electronic switching means 
and image display means, with interconnections between 

25 conferencing rooms locally or at remote sites via telephone 

lines or other communications links. Fabris et al . (U.S. 
Pat. No. 4,516,156) discloses a sophisticated 
implementation of such a system, ' employing satellite links 
for long-distance communications, a full range of camera 

3 0 remote controls {including lens controls and pan- tilt-head 



FNI-015/03 
50704sh 



controls) , and touch- screen monitor facilities for system 
controls of cameras and signal switching. This system, 
however, has no provisions for image storage, or any 
application of image data compression means coupled with 
display means or image storage means. 

Summary of the invention 
The present invention implements an automated 
video monitoring system by way of a PC-based platform 
employing display windowing software, with camera sources 
being interfaced to an input circuit board which includes 
provisions for image data con^ression. Using a basic image 
size in pixels of 320 x 240, aind optionally including color 
processing employing a Y-U-V 4:1:1 or 4:2:2 sampling 
technique, a range of performance standards are 
established. An" economical simultaneous . display of 4 
sources in a 2 x 2 configuration on a conventional 10" 
VGA- format {640 x 480 pixels) monitor may be upgraded to 
a more elaborate 24-source (plus one utility window, which 
also may be used as a graphical -based input source device 
for transmitting control commands to the individual 
cameras) display in a 5 x 5 configuration on a 
high-resolution 20" (1600 x 1200 pixels) monitor. Other 
combinations are possible, including arrays of images of 
size 640 x 480 pixels or even 800 x 600 pixels, depending 
on the screen size of the display monitor and the 
capahilities of the video display adapter circuit card. In 
addition, not all image windows need to be of the same 
size, nor updated at the same rate, but rather they may be 
mixed and combined based on particular applications . 
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Remote controls for the individual cameras may be 
implemented by way of windowing software and/or monitor 
touch-screen devices. Automatic sensing of particular 
events (representing security alarms, equipment or process 
5 disturbances, or a change in the person speaking in' a 

videoconferencing environment) may be employed to cause 
reconfiguration by way of resizing the image or modifying 
the update rate of individual windows on the display 
screen, or by modifying the data format of recording images 
10 on a storage device. 



magneto-optical disks or PCMCIA- compatible disk-drive 
modules . Images are preferably stored as a succession of 
data-compressed representations, corresponding to various 
.window sizes sampled at diverse update rates; however, 



Storage of images may be implemented by way of a 



15 



tape back-up device, such as a DAT or 8 -mm tape recorder, 
which are capable of storing as much as 960 hours of 
monitoring images, or by way of disk storage devices, 
preferably including removable disk drives such as 



20 



though the image representations need not be identical to 
the sizes and rates used for video monitors displaying the 
various images. In an alternative embodiment, cameras are 
provided with data compression means at the camera 



25 



location, with a bi-directional data link providing control 
signals from the PC, and accepting data- compressed images 
from the cameras. Depending on the data rates selected. 



the transmission of these signals may be by means of 



coaxial cables, twisted-pair lines", or fiber-optic cables. 



30 



These signals may alternatively be transmitted over 
internal PBX telephone lines, or over greater distances. 
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including satellite links, as -would be the case for remote 
monitoring of facilities or videoconferencing. The use of 
digital images allows the application of various useful 
techniques, such as digital noise reduction and 
5 motion- sensing, to trigger security alarms, for example. 

It is an object of the invention to provide a 
more efficient method for monitoring camera outputs by 
means of a multiple-window display system implemented on a 
computer platform. 

10 It is another object of the invention to provide 

an improved recording system for event-logging or security 
applications, by means of storing data- compressed digital 
images, including identifying information, which are more 
representative of events than typical analog time-lapse 

15 recordings, and further to implement this system on a 

computer platform. 

It is a further object of the invention to 
provide extended recording time for event-logging or 
security applications by means of either tape-based, or * 

20 disk-based, or both tape-based and disk-based data 

recording means , 

It is yet another object of the invention to 
provide a system for remote monitoring of cameras by means 
of transmission of data- compressed digital images over 

25 communication links. 

It is yet a further object of the invention to 
provide a convenient method of implementing 
videoconferencing facilities by means of a PC-based 
platform. 



7 
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Prief pescr.iptior; of the Prawjngg 
FIGURES 1-6 show various possible screen display 
configurations according to the invention; 

FIGURE 7 is a functional diagram of a PC-based 
5 system wherein plug-in printed-circuit boards implement 

digital processing for analog input signals, - 

FIGURE 8 is a functional diagram of a plug- in- 
printed-circuit board introduced with reference to Figure 
7; 

10 FIGUHE 9 is a functional diagram of a universal 

camera adapter having digital output signals; 

FIGURE 10 is a diagram of an integrated camera 

system; 

FIGURE 11 is a functional diagram of a PC-based 
15 monitoring system adapted for videoconferencing at multiple 

remote locations ; 

FIGURE 12 is an overhead view of a physical 
layout of the system of Figure 11; 

FIGURES 13A and 13B are drawings of a multiple- 
20 camera monitoring unit for table-top use in 

videoconferencing; 

FIGURE 14 is a side-view of an expanded multiple- 
camera monitoring unit implemented for videoconferencing; 

FIGURE IS is a table listing a variety of 
25 possible operating modes, depending on computer monitor 

display facilities, in either a monitoring or a 
videoconferencing version of the invention. 

DgtailecL Pescription of thg Prgferrefl EmbQaiment 

The present invention implements an automated 

8 
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video monitoring system by way of a PC-based platfoirm 
employing display windowing software, with camera sources 
being interfaced to an input circuit board which includes 
provisions for image data compression. The basic video 
window size of 320 x 240 pixels from each camera source can 
be displayed on a variety of video monitors, in a number of 
formats, depending on system complexity. The preferred 
recording medium is a 4 -mm helical -scan data cartridge, 
commonly referred to as. a digital audio tape (DAT) . Each 
tape cartridge is capable of storing 10 GB (gigabytes) of 
data. All recording times in the explanation below are 
based a data-compression ratio of 100:1, utilizing a 4:2:2 
Y/U/V sampling method for color images . Other higher 
capacity media, such as 8-mm tapes capable of 20 GB of data 
storage, may be employed when longer times are desired. 

Figure 15 shows a variety of possible operating 
modes, depending on the particular implementation of the 
PC-based monitoring system. These six representative modes 
will be explained in detail with the understanding that the 
invention is by no means limited to the specific examples 
shown, and that many different alternatives are possible. 
It should be noted also that in certain of the 
implementations shown, the entire screen may not be 
occupied by the various windows, and any unused areas at 
the top, bottom, or sides may be utilized to display 
warning messages, control buttons, or other such 
facilities . 

Figure 1 shows a computer monitor display for a 
system configured in accordance with Mode I as listed in 
Figure 15, Using a commonly available 14" VGA-format 
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computer monitor with a dimension in pixels of 640 x 480, 
four windows having a dimension in pixels of 320 x 240 may- 
be displayed simultaneously. Recording this data at the 
rate of one frame per second (1 fps) in black and white 
(B/W) and with 100:1 data- compression on a 10 GB DAT tape 
provides approximately 960 hours of images per tape, or 
alternatively more than 480 hours of color images. A 
second monitor optionally may be used to display utility 
windows including various system operating controls, as, 
for example, camera pan, tilt, zoom, focus, and so forth. 

Figure 2 shows a computer monitor display for a 
system configured in accordance with Mode II as listed in 
Figure 15. Using a 15" to 17" SVGA-format computer monitor 
with a dimension in pixels of 1024 x 7 68, nine windows, 
each having a dimension in pixels of 320 x 24 0, may be 
displayed simultaneously. Bight windows may be implemented 
as camera displays, and the ninth window may be used for 
the continuous display of the utility window, as described 
above. Recording of ali eight windows at 1 fps will allow 
4B0 hours of B/W images in this configuration per 10 GB DAT 
tape, or alternatively more than 240 hours of color images. 

Figure 3 shows a computer monitor display for a 
system configured in accordance with Mode III as listed in 
Figure 15. Using a 17" to 20" high-resolution computer 
monitor with a dimension in pixels of 1240 x 1024, eight 
windows having a dimension in pixels of 320 x 240 may be 
displayed, in addition to two windows having a dimension in 
pixels of 640 X 480. One of these larger windows may be 
implemented as a utility window, and the other larger 
window may be implemented for sequential display of the 
10 
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eight camera inputs at full camera resolution having a 
dimension in pixels of 640 x 480. Recording all eight 
camera image windows, and also the input-scan window, at 1 
fps will allow 3 60 hours of B/W images in this 
configuration per 10 GB DAT tape, or alternatively more 
than 180 hours of images in color. 

Figure 4 shows a computer monitor display for a 
system configured in accordance with Mode IV as listed in 
Figure 15. Using a 20" high-resolution computer monitor 
with a dimension in pixels of 1600 x 12 00, 25 windows with 
a dimension in pixels of 320 x 240 may be displayed 
simultaneously. Twenty- four windows may be implemented as 
camera displays, and one is implemented as a the utility 
window. Recording all twenty- four windows, and also the 
utility window, at 1 fps will allow 180 hours of B/W images 
in this configuration per 10 GB DAT tape. If color 
recording is desired, a 20 GB 8-mm data cartridge will 
allow 180 hours of color images. 

Figure 5 shows a computer monitor display for a 
system configured in accordance with Mode V as listed in 
Figure 15. Using a 20" high-resolution computer monitor 
with a dimension in pixels of 1600 x 1200, twelve larger 
windows having a dimension in pixels of 400 x 300 may be 
displayed, as well as one large high-resolution window, 
with a dimension in pixels of 800 x 600, to display the 
sequentially scanned output of the camera images. 
Recording in this format at 1 fps will provide 180 hours of 
B/W images in this configuration per 10 GB DAT tape. If 
color recording is desired, a 20 GB 8-mm data cartridge 
will allow 180 hours of color images. 
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Figure 6 shows a computer monitor display for a 
system configured in accordance with Mode VI as listed in 
Figure 15. Using a 14" to 17" SVGA computer monitor with 
a dimension in pixels of 1240 x 1024, and implementing a 
5 smaller window size with a dimension in pixels of 240 x 

18 0, eight windows are available for the camera image 
displays, and two large windows of 480 x 360 are available 
for sequentially- scanned camera images. Recording in this 
screen format at 1 fps allows 480 hours of B/W images in 

10 this configuration on a 2 0 GB 8 -ram data cartridge, and 

allows 240 hours of images. in color. 

In any of ■ the display configurations just 
described, it is also possible to use a video overlay 
technique to display the utility controls superimposed on 

15 the camera video. Regardless of which display or recording 

format is used, the PC based monitoring system includes 
various facilities and features, which will now be 
described in further detail. 

In operation, the user need only observe the 

20 various display windows on the monitor screen, rather than 

concentrate on many monitors simultaneously, thereby 
reducing the risk of missing an important event. Since no 
video switcher is used in recording, and images from all 
sources are continuously recorded at the selected frame 

25 rate for each source, more information is recorded than in 

conventional analog systems, wherein events may be missed 
due to the sequential switching of input images . The 
digital format also improves the picture quality, as the 
signal- to-noise ratio will be higher than for analog 
■30 systems. In addition, there is no loss of quality "during 

12 
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recording or playback, and because the recording technique 
is digital, other types of information optionally may 
recorded along with the camera data, such as audio, time, 
date, location, etc. 
5 An additional feature is the capability to 

implement a dual -recording-media option. This facility 
provides the ability to record simultaneously both on a 
tape (for high capacity, long term storage) and also on a 
removable media, such as a removable hard disk (i.e. 

10 PCMCIA) or magneto-optical disk {for short-term storage of 

up to 24 hours of images) . These disks facilitate high- 
speed searching of recorded information without 
interirupting the tape, as well as providing a back up for 
the recording on the tape. In addition, the system is 

15 capable of simultaneously searching the recorded images on 

the disk storage unit while continuing to store images on 
the tape storage unit . 

It should be noted that there is- no requirement 
that the image sizes or frame rates utilized for the video 

20 display match those utilized for the storage media. In 

practice, these two specifications may not agree, and will 
be determined by other factors, such as operator 
manipulation of the displayed image sizes or changes 
resulting from the detection of alarm conditions . 

25 Figure 7 shows a functional diagram of an analog 

input-digital processing card installed in the PC which 
allows the use of existing analog cameras and cables with 
the PC-based monitoring system. This card, which may be 
obtained from such manufacturers as Nova, Model No. V-SW, 

3 0 features four video inputs 2a-2d having balanced or 

13 
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differential input circuitry for good noise immunity (or 
optically- coupled inputs for fiber-optic cabling) , four 
video ainplifiers 4a- 4d, a 4x1 video switcher 6 by which any 
one of the four video inputs may be selected as a signal 
5 source, and an analog-to-digital (A/D) converter 8. The 

recording of camera inputs is digital, however, there is no 
provision for remote control of camera functions such as 
pan, tilt, zoom, and so forth. If additional inputs are 
desired, multiple cards may be installed in the PC. The 
10 output of the A/D converter B is supplied to the graphics 



picture data rates, computer software is provided to 
implement menu-driven management of the data bandwidth 
allocation to the various image sources. Based on this 
configuration, signals are provided to the video switcher 



15 



processor and image data- compression engine 10. This unit 
perfoirms the various functions required to configure the 
image sizes and frame rates as specified by the equipment 
operator. Because the overall data recording bandwidth of 
the system is a factor in the selection of the individual 



20 



4 to facilitate the selection of the particular image 
sources as required. The data-compressed images are 
provided in digital form to the microprocessor data bus 12 . 
The microprocessor unit (not shown) in turn provides 
control signals to the graphics processor 10 by way of this 



25 



data bus, in accordance with the image data allocation 
configuration selected. 



Figure 8 is a functional diagram of a digital 
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input/output- digital processing card which implements bi- 
directional digital communications to and from the camera/ 
adapter unit over a single transmission line, thereby 
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greatly reducing the cost of cable and installation, and 
allowing existing wiring to tie used. Various 
impleinentations of this printed- circuit card are required, 
depending on the type of network interconnection media 
5 selected. In addition, system performance will depend on 

the type of network, interconnection media. As an example, 
a fiber optic network will have a higher transmission rate 
and better signal quality than a telephone network. 
Interfacing technology for these communication methods are 

10 in common usage and. well known in the art. This 

printed-circuit card also serves four cameras through 
inputs 52a-52d, and additional cards can be implemented if 
required. The bi-directional digital video and camera 
control data switcher 54 serves to select the individual 

15 image sources as explained in reference to Figure 7 , These 

source signals are then provided to the graphics processor 
and image data-compression engine 56, which "provides 
similar functions to those provided by the graphics 
processor 10, discussed in reference to Figure 7. The 

20 processed data-compressed images are then provided to the 

microprocessor data bus 60. However, in this 

implementation, the bi-directional nature of the data 
switcher 54 is exploited to provide full functional control 
of the camera facilities through the bi-directional 

25 controller 58. These functional controls include the 

cameras themselves (lens and exposure control) and the 
camera's physical mounting provisions (pan and tilt) . The 
various control signals for these functions are those 
traditionally provided to these kinds of equipment, and 

30 these concepts are well known in the art. In an 

15 
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alternative embodiment, the individual cameras are each 
equipped with separate image data- compression facilities, 
utilizing such techniques as motion-JPEG or MPEG 
compression. In this case, control signals for these 
additional functions are provided from the ' microprocessor 
bus 60 through the bi-directional controller 58 and the 
data switcher 54 . 

Figure 9 is a functional diagram of a digital 
output universal camera adapter. This is a fully digital 
version of the camera adapter as described in co-pending 
U.S. Patent Application Serial No. 08/050,861, titled. cuCV 
"PERSONAL -COMPUTER BASED VIDEO PRODUCTION SYSTEM"/*. . The 
A/D- converter, digital image data-compressor, and bi- 
directional interface camera adapter 100 accepts analog 
audio and video signals from the camera 102, and converts 
them to digital signals in anticipation of the transmission 
of these signals over the interconnection network 104, The 
camera adapter also receives camera control commands from 
the PC by means of the interconnection network, and 
translates them into the appropriate pan., tilt, zoom, focus 
and iris control signals for the particular camera 
equipment, including the camera lens 106 and the pan/ tilt 
mounting facilities 108. In addition, the camera adapter 
also has inputs for several "alarm system" type sensors 
110, as, for example, motion detectors, photocell 
detectors, or simple switches. These alarm ' signals are 
digitized, encoded, and then transmitted to the main PC by 
means of the interconnection^ network. Power is supplied 
for this equipment from a local source 112. This camera 
adapter is implemented to provide a full-function system, 
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adaptable to all existing types of cameras and. control 
equipment. However, because of the large number of 
interconnections involved in the adapter, camera, pan/tilt 
unit, and sensors, the installation process may be somewhat 
5 complicated. 

By equipping an individual camera input with 
digital frame store capabilities, it is possible to detect 
an alarm condition based on deviations from the 
normal- state image scene. For example, if a camera is 

10 monitoring a door exit or an area of a warehouse aisle that 

is not utilized during evening hours, any change in the 
image would represent an alarm condition. To allow camera 
movement, this sensing process would be disabled during 
pan, scan, tilt, zoom, and other camera positioning 

15 controls, and the sensing would be re-enabled after camera 

positioning ceased, or by manual operator control. 

Figure 10 is a functional diagram of an 
integrated camera system according to the invention 
including means to overcome problems associated with having 

20 a physically separate camera, pan/tilt unit, and adapter 

unit. The integrated system includes a camera 150 with 
pan/tilt control, A/D converter, digital data-compression 
circuitry, and requisite interfacing circuitry. Such 
provisions are preferably included in the camera base 

25 structure 152, which simplifies installation, as no 

separate interconnecting cables are required. The 
integrated camera system optionally may include provisions 
for supplying electrical operating power from a network 
coaxial cable, and thereby may be implemented with only a 

3 0 single interconnecting cable. An integrated camera system 

17 
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of this type may be implemented in a physical package which 
is as small as the camera itself, since most of the 
electronics may be highly miniaturized by developing custom 
integrated circuits including LSI, ASIC, DSP, and mixed- 
5 signal processing. 

It will be appreciated that in any of these 
implementations J alarm or sensor signals may be utilized to 
automatically re -configure the system operating mode, as, 
for example, increasing the frame rate or image size for an 

10 image source associated with the sensor which has initiated 

the alarm signal condition. As explained above, the 
displayed windows and image sizes may be reconfigured into 
an operating mode different from the reconfiguration of the 
digital storage mode. If desired, the operator may choose 

15 to allow the system to automatically adjust the compression 

ratio utilized for a particular window in response to alarm 
signal conditions . Alternatively, the compression ratio 
may be adjusted in response to the selection by the 
operator of a particular window for closer monitoring, by 

2 0 switching to an image window having larger dimensions in 

pixels. For some applications, the use of a resolution- 
independent data compression scheme, such as the "Fractal 
Compression" method of Iterated Systems, Inc., will be 
preferred, since images compressed by this method may be 
25 resized to fit larger or smaller windows as desired, 

without loss of apparent resolution. In addition, 
automatic switching of the audio signals associated with a 
particular window in response to alarm signal condition 
will enable the operator to fully investigate such events, 

3 0 and the audio signals may serve to attract the operator's 

18 
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attention to the event . Such switching optionally may be 
coupled with operator selections for monitoring purposes as 
well, and. in both of these options may be integrated into 
the system previously described for recording the images, 
with or without any associated audio signals, onto the 
mass- storage media. 

Figure 11 illustrates a PC-based monitoring 
• system implemented for videoconferencing at multiple remote 
locations. In this application of the invention, a main 
control center, shown generally as 200, is interconnected, 
by way of a network, with remote locations, shown generally 
as 204 to 210, designated as "1" through "N" . The network 
2 02 may be implemented by way of telephone lines (slow 
speed) , ISDN lines (medium speed) , or alternatively 
coaxial cable or fiber optics cables {high speed) . The 
higher speed implementations permit transmission at higher 
frame rates and higher image resolutions. As an 
alternative, wireless networks or microwave links 
optionally may be used. Network communication between the 
main and remote locations is bi-directional,- the main 
computer receives audio, video, and sensor data from each 
of the remote locations, and transmits controls for camera 
pan, tilt, focus, zoom, and so forth. Audio and video 
communications for the system operators also is provided, 
by means of an additional camera and headset at each 
location . 

The application of these PC-based monitoring 
techniques also may he implemented in cases in which the 
central monitoring area may be located at some distance 
from the remote site. In this case, the physical hardware 
19 




and networking facilities will follow the example shown in 
Figure 11, with the understanding that "Location 1" through 
"Location IN" ' will now refer to separate monitoring for 
security applications or other monitoring purposes. 
5 The purpose of the main control center is to 

manage multiple cameras at multiple locations. By- 
monitoring and controlling the remote locations from a 
central location 220, the system may function without an 
operator at each location. Optionally, additional 

10 computers shown, by way of example, as 222 and 224 at the 

main location may be implemented to simplify the monitoring 
and control of the remote locations. The main control 
center stores the data from remote locations in the main 
control storage facilities, shown, by way of example, as 

15 23 8, 240 and 242, using digital tape and removable media, 

including, by way of example, PCMCIA-based removable media 
or magneto- optical (MO) media. The images may be stored at 
various frame rates and resolutions, depending on the 
requirements for the intended use of the stored images . 

2 0 Intercom provisions as shown as 230, 232 and 234, 

facilitate the coordination of activities between the main 
control center and the various remote locations, and video 
camera, units are provided at each of the computers, shown, 
by way of example, as 244, 245 and 248. 
25 Each remote location includes a PC/monitor 250, 

with multiple video cameras, shown, by way of example, as 
252 and 2 54, including provisions 256 for image and data 
storage utilizing digital tape and other removable media. 
This remote location may be operated under control from 

3 0 either the main location (as described above) , or a local 

20 
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operator, or by specific software designed for automatic 
control. In the case of software-controlled operations, 
provisions are included for control to be assumed by the 
main control center, if necessary. As in the case of the 
main control computers, each of the remote computers is 
equipped with intercom facilities as 2 58 and video cameras 
as 260. 

In the traditional videoconferencing situation, 
only one camera and monitor are used. Unfortunately, this 
results in an iinfiatural scene which provides the users with 
only a single viewing perspective. The use of a wide-angle 
camera lens which is needed to include many people seated 
around a table creates a distorted view, especially for 
those seated furthest from the camera . Figure 12 shows an 
overhead view of the typical videoconferencing arrangement, 
including conference table 300, camera and monitor 302, and 
conference participants, shown as circles as 304. 

Using the PC-based monitoring system, it is 
possible to create a video conference that presents a much 
more natural viewing appearance. As shown in Figure 13 A, 
a multiple -camera, multiple-display unit 310 preferably is 
preferably located directly on the conference table 312. 
This reduces the camera-perspective-distorting effects just 
described, because conference members 314 may be seated in 
a more comfortable' and convenient position. The resulting 
video image is also much more natural . Each controller 
remote site computer- display section 322 (as described 
herein below) simultaneously shows all of the members 
participating in the remote conference, with an individual 
video window allocated for each participant, under control 
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from the PC-based monitoring system operator. In practice, 
the remote site equipment operator will select one of the 
display operating modes as described in Figure 15, 
depending on the number of subjects (came'ra views) and the 
capabilities of the remote site computer equipment. 
Optionally, an additional camera 316 fitted with a 
wide-angle lens will provide an overall view of the 
conference room, in accordance with more traditional 
systems . . • 

To facilitate the aiming of the individual 
cameras for the participants, an arrangement such as that 
implemented at airport gates to assist the parking of 
airplanes (typically an "I" and an "O" formed of neon light 
tubes is utilized for airplane gate parking) optionally may 
be included. In this case, the two indicators are mounted 
so as to overlap only when viewed directly along the' 
optical axis of the camera lens system. Thus, the camera 
position need only be adjusted so as to cause the 
indicators to overlap, thereby assuring that the camera 
correctly is aimed at the subject, A number of microphones 
318 are situated around the conference table in locations 
suitable for proper audio coverage of the participants' 
speech . 

Figure 13B shows a side-view, depicting the 
physical layout of each of the four sides of the multiple- 
camera, multiple-display unit 310. The top unit 320 houses 
the individual cameras (2 to 8 units) and associated 
electronics, optionally including aiming provisions as 
described herein above. An LCD display screen 322 shows 
the various camera images of the conference participants . 
22 
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Speakers located at positions 324 provide audio from the 
remote sites. 

As shown in Figure 14, the multiple -camera/ 
display unit shown in Figure 13B preferably is modular in 
5 construction including removable side panels, in order to 

facilitate expansion along either horizontal axis so as to 
accommodate any size or shape conference table, with each 
section of the unit serving up to four conference 
participants. In the preferred embodiment, the entire unit 

10 preferably is constructed so as to provide a low profile, 

by utilizing slanted LCD display panels 330 to create a 
minimum obstruction for the local conference participants. 
If a low profile design is not required, the display panels 
optionally could be larger, and mounted vertically. Until 

15 color LCD panels become ' more cost-effective, the display 

•unit would be constructed with any of the currently 
available small LCD projector systems. Each conference 
location may include a designated PC operator, however, the 
implementation of the network connection facilitates 

20 control of the system from a remote location. 

It should be noted that the implementation of the 
PC-based monitoring system is not limited to these examples 
of security systems or videoconferencing. Many alternative 
implementations, such as workplace, factory, production 

25 line, and process monitoring, would benefit from this 

system, and these alternative implementations should be 
considered to be within the scope of the invention. 
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A video storage and display system, 
comprising: \ 

a pi^ui^ality of video cameras, each outputting a 
signal representative of a video image; 
5 means toS. receive the signals from each, camera and 

digitally compress che images; 

a computer interfaced to the following devices: 
a displaV screen, 

means to receive an operator input, and 
10 a high- capacity storage medium, 

the computer beingy programmed to perform the 
following functions : \ • 5 

display the digitally coti^jressed images from 
the cameras in different windows Vn the display screen, 
15 each window having a dimension in piscsls, 

vary the dimensions andXthe rate at which a 
particular image is updated in its wiridow in accordance 
with an externally derived command input, \ 

store the digitally compresseii images in the 
2 0 high- capacity storage medium, and \ 

vary the dimensions and the rateVat which a 
particular image is stored in accordance with an externally 
command derived input . \ 

2 . The video storage and display system of 
25 claim 1, further including means for sensing an aspefct of 

the image associated with at least one of the video cameras 
to generate the externally derived command responsible for 
varying the dimensions and the rate at which a particular 
image is updated in its window. \ 
24 
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""S^ The video storage and display system of 
claim 1, further including means^ associated with the 
computer for controlling the ' i^^a ■ ^^hering uapablTl rbxes- 
of one or more of the video cameras . 



The video storage and display system of 
claim 1, wherein the means to digitally compress the image 
from a particular camera is disposed at the location of the 



""■^^ The video storage and display system of 
claim 1, wherein the means to digitally compress the image 
from a particular camera is disposed at the location of the 
computer . 

The video storage and display system of 
claim 1, further including a separate computer associated 
with each camera, the computers being networked together 
over a common communication bus, enabling an operator 
situated at a particular computer to display the images 
gathered b^ ^t her cameras -fee — fee — darsp- layed * in separate 
windows on ^;tke^operator ' s display screen. 

4. 

'"^v The video storage and display system of 
claim 1, wherein the high-capacity storage medium comprises 
a magnetic tape. 

Bv. The video storage and display system of 
claim 1, wherein the high-capacity storage medium comprises 
a magnetic disk. 

25 
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S^-i^f^^^ 9. Th^ video storage and display system of 

claim 1, includinV two forms of high- capacity storage 
media, one being ii;andomly searchalDle while the other 
continues to record. \ 

; ""^^^ method of simultaneously displaying and 

storing multiple video images, comprising the steps of: 

receiving video images from a plurality of 

sources ; 

digitizing one or more of the images if not 
) already in digital form; 

displaying at least certain of the digitized 
images in separate windows on a display device, using a 
first, predetermined frame, rate and resolution associated 
with each window /"^^^ 

IS 

5 simultaneously storing the displayed images using 

a second, predetermined 'frame rate and resolution 
associated with each image. ' 

*3ri^ The method of claim further including 

the step of receiving a command to dotcrmine the. frame rate 

N and STbraojt-, 

3 and resolution associated witli the display of a particular 

image . 

16. . 
"■"IrS^. The method of claim "i^^^ wherein the command 

is based upon an operator input . 

The method of claim T^O^ wherein the command 
5 is based upon an external stimulus . 
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tt4^ The Tiiethod of simultaneously displaying and 
storing multiple video images, comprising the steps of: 

receiving video images from a plurality of 

sources ; 

digitizing one or more of the images if not 
already in digital form,- 

displaying at least certain of the digitized 
images in separate windows on a display device, using a 
first set of temporal and spatial parameters associated 
with each image in each window; 

simultaneously storing the displayed images using 
a second set of temporal and spatial parameters associated 
with each image. 

13. ' ■ IRj 

"''^^S^ The method of claim the temporal 

parameters including frame rate . 

The method of claim ''•3>^ the spatial 
parameters including image dimension in pixels. 
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Abstract of the Disclosure 
A PC-based system for imonitoring and storing 
representative images from video cameras may be utilized 
for security or other monitoring applications. Camera 
inputs from digital or analog sources are individually and 
independently digitized and displayed at a first set of 
image sizes, sampling rates, and frame rates, and may be 
stored in digital form on various recording media at a 
second set of image sizes, sampling rates, and frame rates, 
and these two sets of sizes and rates may or may not be 
identical . Provisions are included for adding detection or 
alarm systems which will automatically alter image size, 
sampling rate and/or frame rate of an individual input 
source, or activate other physical responses. In addition 
to security system monitoring, further applications of the 
invention are disclosed for process monitoring in 
manufacturing environments and also for applications in 
videoconferencing . 
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